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ABSTRACT 



This paper introduces a class of finite-memory determin- 
istic algorithms for the following problem of hypotheses test- 
ing under a finite memory constraint. Let X^X^jX^,... be a 
sequence of independent, identically distributed Bernoulli 
random variables where X^ can take on values H or T. The 
problem is to decide between the two simple hypothesis 
H : P(X^=H) = p vs . T : P(X^=H) = q, where P (# is true) = tt o 
= P(F is true) = = h. The X^'s are observed sequentially 

and a new decision must be formulated after each observation. 
Let the data be summarized after each new observation by a 
2n-valued statistic VeS = {1^, 2^ , . . . ,n^,n t , (n- 1) , . . . , 2 . 1 } , 
which is updated according to the rule = f(V^_^,X^), where 
f : S X (H,T)->S; is the transition function. Let the decision 
rule take action 

d (V = ( 

■ ^ Vjj g ( n.j. > ^ ~ * • * * * t * ^ t ^ * 

at time k. The objective is to find the function f which 



' H is true if v j c e U h » 2 h , . . . ,n h ) 
is true i: 



minimizes the probability of error P(e) = ir o P(d = t\h is 
true) + P(d = H\T is true). 

The algorithm may be taught of as a finite state automaton, 
in which the inputs are the observations, the outputs are the 
decisions, and the states constitute the memory. In this paper, 
the optimal algorithms are found for a small number of states 
(up to 20) . 
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I. INTRODUCTION 



In the near future, computers will play even more im- 
portant roles in every day life than ever. We are expecting 
more compact machines with more working capabilities and 
requiring less human intervention. The idea of designing 
a machine with decision making capability is of great inter- 
est. If such a machine were to be employed in a decision 
process, then we face the problem of trading off the error 
caused by the machine operation against its complexity. In 
a smaller size machine with limited core memory, the error 
caused by the decision under finite memory is even more 
significant. The attempt of designing a small machine with 
limited core size which operates with least probability of 
error is worth of time and effort, especially if such a 
device is to be used for some special tasks. Consider an 
exploration of a distant star with an unmaned spacecraft. 

If a computer with a decision making capability were to be 
used within the spacecraft, it would almost certainly have 
to be small and of limited core size. This kind of machine 
or automaton would be required to make decision with minimum 
probability of error constrained by the available memory. 

In this example, the machine or automaton acts like an 
input-output machine which has the observed data as the in- 
put. The output of the machine are the decisions. Only a 
finite amount of informations can be stored at any time. To 
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construct such an automaton, a form of a decision process 
could probably be adapted from the statistical test of 
hypotheses . 

Let X^,X2>... be a sequence of independent, identically 
distributed random observations drawn according to a proba- 
bility measure T defined on arbitrary probability space. 
Consider the simple hypotheses testing problem 

Hq.* T = T q vs. H^: T = . 

Let the prior probabilities of the null and alternative 
hypotheses be denoted by tt q and tt^ respectively. The goal 
is to find a sequence of decision rules d^ (X^) , d2 (X^ ^2) , . . . 
which minimize the asymptotic probability of error 

P(e) = B [ ^ - •2 1 e.l 

l n -*- 00 n i=l ll 

where 

( 1 if d- ^ H true, 

e i = { CD 

[ 0 if d. = H true. 

Denoting, for a sample of size n, a n the probability of 
type I error and 6 ^ the probability of type II error it is 
well known that a n and B n will exponentially approach zero 
as n becomes large. However, the decision d n depends on 
(X^ ,X2 , . . . ,X n ) , so that, as n increases, the amount of data 
to be stored increases without bounds. Some means of data 
reduction may therefore be desirable. Sufficient statistics 
can sometimes be used to reduce the required size of memory. 
These statistics lose no information when used. Unfortunately, 
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the following example shows that this type of data reduction 
is sometimes misleading. 

Let X ~ N(p,l) with the hypotheses 

H q : u = 1 vs. H 1 : p = -1 

where 

% = *1 = 

A sufficient statistic for this test is Y = X. , 

n i=l i* 

where Y is the value of the statistic after n observations, 
n 

A simple optimal decision scheme is 



d 

n 



' H 0 if Y n i 0 

< 

H., if Y < 0. 
1 n 



The updating rule for Y^ is given by 



Y . = Y + X xl . 
n+1 n n+1 



Thus Y contains all the desired informations about 



n 

fX 1> X 0 ,...,X ), and only Y needs to be recorded at the time 
n. However, Y^ is real-valued so that a potentially infinite 
storage is needed for it alone. If the memory can store a 
real number then it can store any number of real numbers so 
that no saving is actually achieved. The attempt of round- 
ing off the sufficient statistic to some finite number of 
digits need not be optimal. In fact, Cover [2] has shown 
that the error probability need not tend to zero if rounded 
off statistic is used. If constrained by finite memory, 
some other statistic must be devised in cooperation with 
some appropriate decision rule. Before further discussion 
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of this topic, it would be worthwhile to look at the liter- 
ature survey concerning a decision model constrained by 
finite memory. The first mention of finite memory in con- 
nection with a statistical decision problem is to be found 
in [1]. This paper by Robbins discussed the problem of 
choosing one of two ways of action, each of which may lead 
to success or failure, in such a way as to maximize the 
long-run proportion of successes obtained. The choice each 
time is allowed to depend only on a finite number of past 
observation. Suppose we have two coins and we wish to 
maximize the number of heads thrown during a sequence of 
tosses. If we had prior knowledge of which coin has the 
larger probability of turning up a head, we should use it 
exclusively, irrespective of the outcomes of previous tosses. 
Then, with probability 1 

lim number of heads in first n tosses m v 

= max fp, ,p 0 ) , 

n-*-°° n vr l * 

where 

t h 

p^ = probability of head for the i — coin. 

If no information about p^ and ^2 is available, then 
there still is some decision rule which asymptotically 
achieves the above limit. Robbins had come up with the fol- 
lowing decision rule, said to be of type r if the decision 

h 

as to which coin will be used for the n— toss depends only 
on the results of tosses n- r ,n- r+1 , . . . ,n- 1 . "Define the 
rule R as follows: start tossing with coin 1, stop if the 

first toss is a tail, otherwise continue tossing until the 
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first run of r consecutive tails occurs and then stop. This 
defines the first block of tosses with coin 1. Now start 
tossing with coin 2 and apply the same rule, obtaining the 
first block of tosses with coin 2. Then start again with 
coin 1 and apply the same rule, obtaining the second block 
of tosses with coin 1 and so on indefinitely, thus generating 
an infinite sequence of tosses consisting of alternate blocks 
of tosses with coin 1 and 2." With rule R r , of type r so 
defined Robbins proved that with probability 1 

lim numbex of heads in fixst n tosses _ ^1^ ^2^ + ^2 ^ ^1^ 



n+°° 



n 



(l- Pl ) r * d-p 2 ) r 



and note that 



lim 

n -*oo 



p l C 1-p 2^ r + P 2 d- Pl ) r 

(1- Pl ) r + (1-P 2 ) r 



max (p 1 ,p 2 ). 



So the rule R r is the best among the other of type r 
which maximize the long-run proportion of heads obtained. 

Although Robbins in his paper did not consider hypotheses 
testing problem, the paper nevertheless stimulated the idea 
of using a finite memory in statistical decision. By using 
the same m-finite past memory as in [1] , Cover [2] developed 
a decision rule using a 4 states memory alogrithm for the 
hypotheses testing problem as applied to Bernoulli trials. 

The details of this can be found in [2] . 

The first actual finite state memory algorithm was pro- 
posed in [3] and [4] by Heilman and Cover. Here the past 
observations were stored as a state of a machine constrained 
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to have only m states. Consider the two hypotheses testing 
problem as stated earlier, where 



H n : T = T vs H 1 : T = T . 

0 o 1 1 

and the prior probabilities P (Hq is true) = tt o and P(H^ is 

true) = tt^. 

After each observation, let the data be summarized by 
an m-valued statistic Ve { 1 , 2 , . . . ,m} where the updating 
scheme is V n = f(V n _ 1 , X n ) ; f : {1 , 2 , . . . ,m}XW->{l , 2 , . . . ,m} 
where X.eW the set of values which X. can take on for 

l l 

i = 1,2,... and f is the transition function. 

Let the decision rule be defined as 

d n = d(V n ); d : (1,2,. . . ,m} - {Hq,^}. 

The pair (f,d) then describes a finite-state automaton with 
inputs X n and outputs d n = d (V ) and state space S = {1,2, 

. ..,m}. Here V n is the state at time n. Under hypotheses 
Hq or H^, the sequence V n , with some specific initial state, 
forms a Markov chain over the state space S. In order to 
minimize 



P ( e ) 



I” lim 


1 n 1 
- .S- e. 


1 n-*- 00 


n i=l ll 



where e^ is the error as defined in (1) , we need to find the 
optimal pair (f,d). Heilman and Cover have established a 
lower bound for P(e) as follows. 

Let fg and f^ be the probability densities of the sample 
under the respective hypotheses with respect to a dominating 

f o (x) 

measure. Define the likelihood ratio to be £(x) = x — • 
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Let i denote the essential supremum of £(x) and the es- 
sential infimum of l (x) where the supremum and infimum are 
taken over all measurable sets with positive dominating 



It was further proved in [3] that the same bound P* also 
hold for P(e) in a reducible (m+1) -state automaton. For a 
special case where tt = = h, the P* for the irreducible 

m-state automaton becomes 



If the m-state automaton is reducible, the bound becomes 



The ratio y = X/£ is a measure of the separation between 
the two hypotheses. Notice that P* decreases exponentially 
with m. 

However, Heilman and Cover have shown that, except for 
degenerate cases, no machine can actually achieve the bound 
P*. But as an example in Bernoulli case, an e-optimal class 
of automata (i.e., such that for any e > 0 there exist an 
automaton with P(e) < P* + e) was introduced. The detailed 



We call the automaton irreducible (reducible) if the 
result Markov chain formed by sequence {V } under both 
hypotheses is irreducible (reducible). n 



measure. Define y - £./£. Then for an irreducible'*' in- 
state automaton, we have P(e) > P* where 




1 



i 



i 



i 



is 



description of this class of automata is as follows: Let 



be a sequence of independent, identically dis- 
tributed Bernoulli random variables where X. can take on 
value H or T, let the two hypotheses be 



where the prior probabilities are u o = = % and = 1-p^ 

for i = h , t . 

Without loss of generality it may assume that p^ > p^, 

in which case, I = P h /P t 5 A = %^t and Y = = p h q t /,p t q h 

If the hypotheses are symmetric, that is if = 1 " P t > 



then y = (P h /q h ) 2 J hence P(e) > 1/^1 + (p h /q h ) m " ^ for an 



H : P (X i =H) = p h vs. T : PCX^T) = p t - 



irreducible m-state automaton, and P(e) 




for a reducible m-state automaton. 



Let the transition function f be defined as follows (see 



Figure 1) : 




if X = H 



if X = T 



for i = 2,3 



m- 1 



2 



with probability 6 > 0 if X = H, 



£(i,x)= < 



l 



otherwise 




m-1 with probability k6 > 0 if X = T 



otherwise , 



where k = 1 for the case of symmetric hypotheses. 
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The transitions are made to the adj acent , states only 
when the event X = H or X = T are observed. Otherwise, the 
state does not change. This automaton will reach an end 
state only on strong evidence to support the corresponding 
hypotheses (i.e., to enter state m, preference on H is 
strongly and vice versa for T ) . However, leaving the end 
states has only a very small chance when 6 is small. A 
decision made at the end states results in the smallest 

V 

probability of error and as 6 -»■ 0 , the error probability 
P(e) should asymptotically approach P* . 

The Hellman-Cover algorithm is useful in providing 
sequences of decisions, but not very suitable for the case 
when only a single decision is required. The irreducible 
automaton will asymptotically approach the lower bound for 
P(e) after a 'large enough" number of observations and there 
is no way to tell how large the number should be. In case 
when we need a more reliable decision we may have to wait 
for a long time. In addition, the automaton requires arti- 
ficial randomization for generating the probabilities 6 and 
kS to transit out of the end states. Such a random generator 
needs additional memory to be added to the automaton and it 
will no longer be a finite state automaton if we need a very 
small 6 as close to zero. 
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On the same problem of the Bernoulli case, viewed as 
two-ways Bernoulli classification problem, Shubert had 
introduced in his paper [8] a deterministic machine which 
can perform as well as optimal randomized machines only if 
the machine memory is increased by less than one bit. This 
class of algorithm use the data source itself to provide 
the necessary randomization. The problem of finding a 
truly deterministic algorithm has been considered by Ander- 
son in his thesis [5] . He developed a special class of 
symmetric (2n+3) -state algorithms with two absorbing 
states. The algorithm can perform a decision process with- 
out randomization. 

He defined the transition function f as follows (see 
Figure 2) : 



f(s,H) = s+1 , 
f(s,T) = s - 1 , 
f(s,H) = 1 , 
f(s,H) = s , 



f(s,T) = s-p(s) 
f(s,H) = s + p(s) 
f(s,T) = -1 
f(s,T) = s 
re 1 < p(s) < s. 



if s = 1,2,. . . ,n 
if s =-1,-2,. ..,-n 
if s = 0 
if s = ± (n+1) 



This algorithm, however, has higher probability of 
error than the randomized machine. But it was shown in [5] 
that, if the randomization is provided for this determinis- 
tic machine, the Hellman-Cover lower bound for P(e) can be 
approached arbitrarily closely. 

In this thesis, another class of the deterministic 
algorithm is introduced and investigated. The class is of 
ergodic type and it is the only characteristic in which it 
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Figure 2. An Algorithm f = <p(l), ... , p(n) >. 
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differs from the one discussed by Anderson [5] . Since there 
were a lot of similarities in this paper and Anderson's 
paper, the sections concerning the proof of achieving the 
bound with randomization and deriving the asymptotic bound 
for P(e) are omitted. However, the determination of the 
probability of error in terms of the algorithm is presented 
in the complete form. The search of optimal algorithms for 
the cases of small number of states have been done by alge- 
braic computation in some cases and by computer search for 
the other. The results are summarized in Table I and Table 
II with Figures 5, 6 and 7 to provide clearer idea of the 
trend for larger number of states. 



\ 
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II. DESCRIPTION OF THE ALGORITHM 



Let be a sequence of independent identically 

distributed Bernoulli random variables where 

X i eG = {X : X = H or T} for all i = 1,2,3,... 

Consider the simple hypothesis testing problem 

H : P(X i = H) = p vs. r : P(X i = H) = q, 

where 

h < p < 1 and q = 1 - p. 

Denote the prior probability of H being true as and 
denote ir^, the prior probability of T being true. Here only 
the case = tt = %, the symmetric hypotheses testing prob- 
lem will be considered. The sequence of random variables 
X^,X 2 ,X 2 »... can be viewed as successive tosses of a coin 
which is biased towards heads under hypothesis H or biased 
towards tails under hypothesis T. 

Let = {r (2) ,r(3) , . . . ,r(n) } be a sequence of positive 
integers such that 1 < r(i) < i for i = 2,3,...,n; where n 
is any positive integer. 

With each r_ we associate a finite -memory symmetric 
algorithm (M,f ,d) (See Figure 3) , where M is defined to be 
a set of 2n states such that M = { (1 ,h) , (2 ,h) , . . . , (n ,h) , (n , t) , 
. . . , (2 , t) , (1 , t) } . The subscripts h and t indicate the states 
in which the decision in favor of the hypothesis H and T 
respectively is made. In other words, the decision rule d 
is d{(i,h)} = H and d{(i,t)} = T for i = 1,2,. . . ,n. 
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The transition function, f is defined by 



f{(i,h),H} 



( r (i) ,h) 



£{(i,h),T} 



(r(i),t) 

( (i + l) >h) 

C(i + D,t) 



£( (1 >h) ,H} = (l,h) 
f ( (1 > t) ,T} = (l,t) 
f{(n,h),T} = (n,t) 
f{(n,t) , H } = (n ,h) 



if i = 2,3, ... ,n 



if i = 1 , 2 , . . . ,n 



With the sequence X^jX^jX^,... of independent identically 
distributed random variables as the input, the states of the 
algorithm (M,f,d) form an ergodic Markov chain. The transi- 
tion probabilities are 



P{(i,h) — (r (i) ,h) } 

P( (i » t) -+- (r(i) ,t) } 
P{(i,h) --+ (i + l ,h) } 

P{ (i , t) (i + l ,t) } 

P{(l,h) — (l,h)} 
P{(l,t) - (l,t)} 

P{ (n ,h) --+ (n , t) } 

P { (n , t) - (n ,h) } 



P 

q 

q 

p 

p 

q 

q 

p 



if i = 2,3,. . . ,n 



if i = 1 , 2 , . . . ,n- 1 



under the hypothesis H. Under the hypothesis T, the transition 
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Figure 3. The Algorithm f = < r(2) ,r (3) , . . . ,r(n) >; where 
(r(i)ij) is the state that the transition transits from 
(i, j) , j = h,t. 
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probabilities have the same form as above with p and q are 
interchanged in places. 

From now on, the specific form of the algorithm (M,f,d) 
will be denoted by f = < r > = < r (2) ,r(3) , . . . ,r(n) >. 
Figure 4 shows the algorithm and the transition matrix of 



the case where n = 4 and f^ = < 1,1,3 >. 






Transition Diagram for 


£ 4 = 


< 1,1,3 


> 








(l,h) 


(2,h) 


(3,h) 


C4,h) 


(4,t) 


(3 , t) 
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0 


0 
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0 
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0 


0 
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0 


0 
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0 
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0 
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(2 , t) 
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0 
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(l,t) 
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0 


0 


0 


0 
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q 


Figure 


4. Illustration 


of Algorithm 


Diagram 


and the 


Transition 


Matrix 
= < 1, 


for the Case 
1,3 >. 


of n = 


4 and 


f 4 (r(2), 


r(3), 


r (4) ) 
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III. DETERMINATION OF ERROR PROBABILITY 



Let S h ( ( 1 > h) , (2 ,h) , . . . , (n ,h) } , le t S^. {(n,t),(n-l,t), 

. . . , (2 , t) , (1 , t) } be the two subsets of the set of states M. 
Define P(s), sc be its stationary probabilities and 

let 

ut V = and • seS “C 5 ) 

h t 

be stationary probabilities of the state being in and 
respectively. With the decision rule d, the probability of 
error can be written as 

P (e) = T\ h P (d = T\H) + Ti t P (d = H\T) 

= % P(seS |ff) + h 'P(seSjJr) . 

By the symmetry of the algorithm we have 
P(seS t |tf) = P(seSjJr) that is 

P(e) = P(seS t | H) 

P(seS t |ZT) 

_ P(seS t |ZT) + PCseS h |^ 

r p(scs h i«) v 1 ( p(s h ) r 1 

■ I 1 * FTiTspsrj = * RS7T ) ■ 

In order to obtain explicit expression for the probability 
of error in term of the algorithm f , we now prove the fol- 
lowing propros ition . 

Proprosition 1 : Let f = < r (2) ,r(3) , . . . ,r(n) > be given. 

Then, 
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"< s h> 

uTS^J 



> 




where and are polynomials in q and p respectively 
satisfying the recurrence relations: 



Hence, both A and B have integral coefficient and are of 
n n 0 

degree less than n. 

Proof of Proprosition 1 

Let P be the transition matrix for the chain f , where 

n 

first n rows and columns correspond to states (l,h),(2,h), 
...,(n,h) and the following n rows and columns to states 
(n , t) , (n- 1 , t) , . . . , (1, t) . 



Let u = (y(l,h) , . . . ,y (n,h) ,y(n,t) , . . . ,y(l,t)) be the 
stationary distribution, so that 



where I is the identity matrix. Partition the matrix P into 
four submatrices in the form 




vi C I - P) = 0 



Cl) 



p 



h 




P 




P 



t 



where P, is an nxn matrix of the form 
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row: 




p q 0 

p 0 q All 0 ' s 0 



1 

2 



P 0 q 




(i) 



p o q 



o 



i 



column : 



1 2 



r (i) i 



q 

0 

n 



n 



and is an nxn matrix of the form 



P t = 



P 

0 



p 0 q 



row : 
n 



r (i) 



column : 



0 

0 

n 



p 0 q 

P q 

i r(i) 2 1 



2 

1 



According to the sequence r., these 2 matrices will have 
all entries located in the same form except that they are 
opposite to each other in both position and p,q values. 
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Notice that each row of these matrices contains exactly 

til 

one entry q namely the (i,r(i)) — one, and that the label- 
ling of rows and columns of begins at the lower right 
corner while the labelling of begins from the upper left 
corner. The off-diagonal matrices and Q consist of all 
zeros except for the lower left corner of which is q, 
and the upper right corner entry of Q , which i-s p. 

With this partition, equation (1) decomposes in to two 
equations 



P h (I " P h^ = (°>°> • • • ,0,y(n,t)p) (2) 

U t (I - P t ) = (y (n ,h) q ,0 , . . . ,0) , (3) 

where 



y h = (PC 1 * 11 ) »• • • , U Cn ,h) ) 

P t = (y (n,t) ,. . . ,y (1 ,t) ) . 

From (2) we have y, = (0 ,0 , . . . ,0 ,y (n ,t)p) (I - P,) 



Let 



a ij = entry of (I - P h ) _1 



. . y(i,h) = y(n,t)pa nji , i = 1,2,. ..,n. 
Using the formula for matrix inversion we get 



a • 



iJ 



( V p hh3,i) 

I - P, 1 



( 4 ) 



where |I - PjJ is the determinant of (I - P^) and (I - P^) ^ ^ 
t ll 

is the (j,i)— cofactor of (I - P.) matrix. Hence 
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(5) 



M( s h ) 



i ? 1 y(i,h) 



P (n l ^ ) P V ( T .O') 

| I - K 1 i=l (I ? h ( i , n) 



Let A be the determinant of the nxn matrix obtained 
n 

from (I - P^) after replacing the n— column of (I - P^) 
matrix by a column of l's, 



A 



n 



q -q 1 

-p i -q 1 

-P * 

• • 

1 -q 1 

. 

-p 1 -q 1 



-P 



1 



( 6 ) 



Expanding A n along this last column we obtain 



n 



A = . Z, (I - P, ) r . v , 
n i= 1 v rr (i , n) * 



since the (i,n) — cofactors of A and (I - P^) are identical 
thus y(S^) in (5) can be rewritten as 



M(S h ) - 



n 



Since the only transition between and is through 
state (n,h) and (n,t) we must have 

P(n,t)p = y(n,h)q (7) 

in the stationary regime. 
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Using the identity in (4) we get 



U - Vfn nl 
M (n ,h) = p(n,t)p n 



and substituting in (7) we get 



|i - P h l - q(i 

Consider (I 



P b) (n,n) * 

P, ) , which has the form 

h (n,n) 



q -q 

-p i -q 



(I - P h ) 



(n,n) 



-p i -q 



-P 



-P 



1 -q 



• -q 
1 



which is the same as the determinant of the (n-l)x(n-l) ma- 
trix I - obtained for the chain f Putting temporarily 

the superscript (n) for the number of states in S^, we have 
a recurrence relation 

id") - « q | d n_1) - pt n ‘ 1) | 

Since 

I (1) - p£ 1} | = q 

we obtain 

|j(n) . pC n ? | „ q n. 
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Thus 



y(S h ) = -§■ M (n , t) p . 

q 

Going back to (3) and repeating all the steps found 
above we can end up with the similar expression 

B 

M(S t ) - u(n,h)q 
P 

where B„ is the determinant of order n 

1 -q 

• • 

-q 

• • 

1 -p 1 

-p 1 -q 

1 -p -p 

B is the determinant of the matrix (I - P. ) after we 
n t 

replace its n— column (in the most left hand side) by a 
column of l's. 

Hence, using (7) again, we have 

Mf V A n 

Rsqr - q n B n 

and it left to prove that A and B have the form as stated 

1 n n 

in (a) and (b) . 
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Consider A first. To evaluate this determinant let 
n 

I 1 = { i = 2,3,. ..,n: r(i) = 1}. 



Notice that 1^ is the set of exactly those rows indices i 
for which the (i,l)— entries in (6) are -p. Multiply the 
first row in (6) by p/q and add it to all rows such that 
iel^. This operation does not change the determinant of 
the matrix. So we have 




The entries in the last column are given by 



1 + 2- if iel, 

q 1 

1 if HI 1 

Expanding this determinant along the first column we 

have 

D 2 (n) = qD^ , 

where 

= A n is the original determinant (6) and 
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q -q 
-p 1 -q 




D 



(n) _ 
2 



-P 



1 



-q 




This determinant is of order n-1. Notice that the 
tries in the first column in the determinant D.£ n ^ are 
only for row indices 1 = 3,...,n such that either r(i) 
or r(i) = 2. Hence, letting = {i = 3,4,...,n: r(i) 
multiplying the first row in hy p/q and adding to 

with ie^ this determinant becomes 



q -q 

o q -q 




1 -q 



"P 



1 -q 



t ( n ) 

3n 



The entries in the last column are 



en- 

P 

= 1 
< 3}, 
rows 



33 



t O) + a t O) 

2i p l 22 



(n)_ 



"3i 



= < 



(n) 

2i 



if iel, 



if i^I 2 



Expanding again along the first column we have 
D 2 (n) = qD< n) , 



where 



,(n) _ 



q -q 



t (n) 
o3 



i -q 



-p 



(n) 

3n 



Proceeding in this fashion we obtain a sequence of de- 
terminant , D^ 11 ^ , . • • ,D^ n ^ (8) 

where determinate is of order n-k+1. The entries t^^ 

in the last column of satisfy the recurrence relation 



t (n) - 
x k+l, i 



t (n) + q t (n) 
r ki p. X k,k 



t (n) 

r ki 



if iel. 



( 9 ) 



if i^I k > 

k = l,2,...,n; i = k,k+l,...,n; and t| n ] = 1, where 

1,1 
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I, = {i = k+1 ,k+2 , . . . ,n: r(i) < k}. 



Further 



so that 



n( n ) = a n( n ) 

u k+l qU k 



D, (n) - qH'V 11 ) - q^M" 5 
1 n n n n,n 



( 10 ) 



Consider the determinant A of order n+1 obtained by 

n+1 7 

using the same sequence r, 



n+1 



q -q 

•p i -q 



1 

1 



-P 



1 -q 



-P 



-q 



-p 



1 1 
1 



Applying the above procedure to D^ n+ ^ = A n+ ^ we obtain 
a sequence 



i (n+1) 



D ( n+ !) 

’n + 1 



( 11 ) 



where the determinants again satisfy (9) with n re- 

placed by n+1. Arrange now the last columns of the sequences 
(8) and (11) into triangular arrays as follows: 



35 



. (n) 

1,1 



■(n) _ 



= < 



•J* ( n+ 1 ) _ ^ 



(n) 


t (n) 




1,2’ 


^2,2 

• 




(n) 


• 

t (n) 


t (n) 


1 ,n ’ 


z 2,n> ' ’ ‘ 


’ n,n 


(n+1) 






1,1 






(n+1) 


t (n+1) 




1,2 


’ ^2,2 
• • 




(n+1) 


• • 

+. (n+1) 


t (n+1) 


l,n 


’ l 2,n’ ’ * 


' * ’ l n ,n 


(n+1) 


t (n+1) . 


t (n+1) 

• • y c n n + 1 y 


1 ,n+l 


’ z ,n+l * 


11 j 11 JL 



Since for i < n by the definition of sets I^ n -^ , iel^ 11 ^ 
if and only if iel^ n+ ^ , the first n rows of and T^ n + ^ 

are identical, i.e., 

+ (n) 



'k,i 



t k^i 1 ' ) » 1 = k »- • • » n 5 k = 1 >2 , . . . ,n . (12) 



Next by (9) 



t ( n+1) 
r k ,n+l 



if k = 1,2,. . . , r (n+1) 



< 



k-1 

1 + 2 - „£ 



(n+1) 



q £=r(n+l) &, H if k=r (n+1) +1 , . . . ,n+l 
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In particular for k = n+1 since r(n+l) < n+1 



(n+1) 
n+1 ,n+l 



1 



+ 



E 

q 



n 

£.=r (n+1) 



t (n+l) 



But by (12) for Z < n+1, we have 



t (n+1) = t (n) 

z l,l l, l ’ ’ ' 

Hence, from (13) we have 

t (n + l) = 1 + E S 
n+1, n+1 q £=r(n+l) 



t 



t 



(*) 
a, z • 



(*) 
z,i • 



Hence, by (10) 



,(n+l) 



n 



= 1 + £ 



n 

Z 



,(*) 



q 2=r(n+l) £-1 * 



Since D 



(n) _ 



= A , we have 
n 



( 13 ) 



A n+1 qI1 + p £=r (n+1) A Jt q » n 1,2 »*** 
where = 1. 

The recurrence relation for is established in exactly 
the same fashion. Notice that the difference of determinants 
A^ and B^ is only p and q are in reverse position, thus on 
the same sequence of r^ we have 



B 



n 



n 



n- 2. 



n+1 p + q £=r (n+1) B £ p ’ 11 1,2 ’ ( ^ 15 - ) 

From (14) and (15) we had completed the proof of propo- 
sition 1. 
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IV. DETERMINATION OF OPTIMAL ALGORITHM FOR SMALL n 



Since the error probability is 




in order to minimize P(e) we need to maximize the ratio 



Thus the ratio y(Sv)/y(S.) is maximized if A /B is maxi- 
mized. The ratios A n /B n depend on the sequence f (r) = 

< r (2) ,r (3) , . . . , r (n) >. After we have determined all pos- 
sible algorithms f (r) (there are (n-1)! possible algorithms 
in total) and computed the corresponding value of A n /I$ n we 
can search for the maximum A /B . This way we can identify 
the optimal algorithm f*(r) and obtain the maximum value of 



In what follows we carry this program for the case of 
small n. For the case of n = 1 , we have P(e) = q which means 
that the decision made without any memory can be done with 
probability of error equals to q. 

Ratios A n /B n were calculated algebraically for n = 2, 3, 

4 and 5. For the value of pe(%,l) it was found that 



y(S h )/y(S t ). 



From the last section, we have 




where 



h < p < 1 and q = 1 - p. 



y(s h )/y(s t ). 
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3 2 2 

q + p q + p 

3 2 2 

p + pq + q 



for any f 




for any f 



for ft- < 1,1, 2, 4 > 



The algebraical work to determine these values is con- 
tained in Appendix A. 

For values of n from 6 to 10, several values of p > h 
were chosen. The search for the optimal algorithm was per- 
formed by using an IBM 360/67 in double precision. The 
program found in Appendix B was becoming too time consuming 
when n exceeds 10. For the values of p in the vicinity of 
1, value of p at .99 and .999 were used. However, in the 
vicinity of h, the optimal algorithm was determined by a 
Taylor series expansion around ^ + e , and neglecting terms 
with e having power greater than or equal to 2. The deri- 
vation of this expansion was as follows: 




where R is the remainder term. 



Ignoring the terms which have e 11 where n > 2 , we get 



A n (^ -e) = A n (^) ‘ • Similarly B^ +e) = A n ( h) + 

eA^ (%) . Consider 
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X = 



A (q) A - eA' 
n^' n n 



b^pT 



A + eA' 
n n 



A' 

"'K 

A' 
n 



1 + e 



n 



To maximize X, we minimize A'/A . 

’ n n 

respect to q we get 



Differentiating A^ with 



A ' 
K+l 



(q) = kq 



k-1 



£=r (k+ 1) q 



k- £+1 



A * 
A £ 



Cq) 



Z (k-£- 1) 
t=r (k+l) 



An (q) q 



k- £ 



which is recursive in A£ and A^, where q = h. 

The program for the search of the ratio A’/A„ is at 
Appendix C. Notice that this approximation of p value yield 
the same result in term of optimal algorithm as in the case 
when p = .51 shown in Table I and II. 

These results are summarized in Table I, Table II and 
Figure 5, 6 and 7. Table II presents the results of Table 
I in the form used in [5] by Anderson. The result was not 
so much different although, the algorithm presented here has 
no stopping rule. After some amount of observation were 
received the decisions are made with the same probability of 
error as in [5] . Anderson in his paper made a point that 
the finite -memory algorithm seems to operate in a similar 
fashion as a human decision making process. The result of 
this paper seems to support his observation. The mechanism 
of remembering and forgetting seems to resemble somewhat the 
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procedure of making decision under finite memory constraint. 
The fact that man can gain experience and learn during his 
entire life span, this makes one to believe that there must 
be some kind of data summarized mechanism such that he can 
make a decision with some degree of confidence at a given 
moment. The word experience may be one of the key which 
can lead to further study about the mechanism of data sum- 
marization. The algorithm proposed in this paper can be 
viewed as a data summarized procedure under simple hypotheses 
with Bernoulli observations. The more complicated machine 
can be developed by considering the general case of multi- 
ple hypotheses testing under finite state memory. The idea 
was discussed in [7] by Yakowitz and in [9] by Salagowicz. 
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Optimal Algorithm f* = < r(2), ... ,r(n) >,r(i) = State that the Transition Goes from 
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Optimal Algorithm f* = < p (2) , . . . , p (n) > p(i) = Number of States that the Transition 

Transits From State i. 



Natural logarithm of max (A n /B 



# 




Figure 5. Graph of an max ~ vs. p values. 

n 
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Natural logarithm of max (A /B 




Figure 6. 



Graph of iln max (A /B ) vs. 

n n 



n values (p from .50-. 70) 
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APPENDIX A 



Determination of (A /B )* and f* algebraically for n=2, 

n n n ' 

3, 4, and 5. Recall that we have 
A k+1 q + Pj.=r (k+l) A )l q 

B W ' P k + < lJr(k + l)V k ' ! '- 

The case of n = 2 , we have the unique algorithm f = <1> 
because the transition from state 2 to state 1 can be done 
only by the jump of 1 or r(2) = 1. According to the formula 
above we have 

A 2 = q + p(A^q°) = q + p = 1 where A^ = 1 

= P + q(B.jp 0 ) = p + q = 1 where = 1 




The case of n = 3 , we have two possible algorithms to 
investigate, namely, 

< 1,1 > 

< 1,2 >. 

< 1,1 >; 

q 2 + P(A 1 q + A 2 q°) 

1 
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• 2 

. . A 3 = q + pq + p 

= q + p 
= 1 . 

By the same derivation, 

B 3 = p 2 + pq + q 

= p + q 
= 1 




1 . 



For 

f 2 = < 1,2 > ; 

A 3 = ^ + P A 2 
= q 2 + p 

and 

B 3 = P 2 + q- 

But 

2 2 

p + q = q + p 




for ^<p=l-q<l 



Note that, the superscripts at the ratio are for numbering 
purposes . 

Thus for the case n = 3, the optimal algorithm can be 
* 

either f^ = < 1,1 > or f* = < 1,2 >. 
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Before we proceed the proof for the case n = 4 and 5, we 

note that the expression for and B n differ only in p and 

q being interchanged. For this reason, the expressions for 

B n will be presented without computation. 

Determination of A /B and f* algebraically for n = 4 

n n n ° 

and n = 5. Recall that 

A k+1 qk + p £=r (k+ 1) A £ q 

o k . v d k+2. 

B k*l ' ? + Mr(k*l) B *P • 

For the case when n = 4, the possible forms of algorithm 

are (n - 1) ! = 3 I = 6 , which are as follows 

fj = < 1,1,1 >,£]=< 1,1,2 >, f 4 = < 1,1,3 > 

fj = < 1,2,1 >, f* = < 1 , 2,2 >, = < 1,2,3 >. 

The optimal algorithm among these combinations is f| = 
fj and (A 4 /B 4 )* = (A 4 /B 4 ) 3 = (q 3+ pV(J> 3+ q) where superscript 
labels the combination order. 

Proof 

For fj; 

A 4 = q 3 + P (A x q 2 + A 2 q + 

A 3 = q 2 + pCA^q + A 2 ) 

A 2 = q + pA-j^ 




and 
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A=q +pq+p=q+p=l 



hence 



A 4 = q + pq + pq + p 

= q 2 (q + p) + pq + p 

= q 2 + pq + p = 1 . 

The same result can be obtained from computing 

,1 




IT' = !• 



It was proved that the case when n = 2, the transition 
always goes to 1. So the value of A 2 always equals to 1 so 



as B 2 . 



For ft 



= < 1 , 1,2 > ; 



where 



^4 - q + pCA 2 q + a 3 ) 



q + p (A^q + a 2 ) 



a i = a 2 = 1 



= q 



pq 



p = 1 



A. = q + pq 



B 4 = p + pq + q 




B 

For f 



= a + . pq + p 

p 3 + pq + q 
= < 1,1,3 > ; 



A a = q + pA. 



SO 



1 




A 



4 



A 



3 




For fj 



hence 



A 



4 




since 



q + p 
-6 



For £ 



q 3 + p 

q 5 + p 

3 

p + q 

< 1 , 2,1 > ; 

q 3 + pCA-jq 2 + A 2 q + Aj) 

q 2 + pA 2 
2 , 

q + p 

q 3 + 2pq 2 + p = q 2 + pq 2 + p 
q 3 + 2pq 2 + p 

3 2 

P + 2pq + q 

< 1,2,2 > ; 

q 3 + P(A 2 q + A 3 ) 

q 2 + p 

3 2 2 2 

q + pq + pq + p = q + p 




p 2 + q. 

< 1,2,3 > ; 
q 3 + pA 3 
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A 3 = q + p 

• • A 4 - q 3 + pq 2 + p 2 
- q 2 ^ P 2 



= 1. 



* * VB 




Consider 1 > p where p > 

^ 2 
P > P 



1 > p - p + 1 

2 2 2 

1 > p + q = p + pq + q 

p - q > (p - q) (P 2 + pq + q 2 ) = p 3 * q 3 
q 3 + p > p 3 + q 



> 1 

p + q 

or (A 4 /B 4 ) 3 > 1 and (A^) 1 , (A 4 /B 4 ) 5 and (A 4 /B 4 ) 6 are 
dominated. 

Stated without a proof is the following simple fact; 
Let a > 0; b >0 and c > 0 

if a/b > 1 then a/b > a + c/b + c. 

This result will be applied when needed without notice. 



q 3 ... + p > a 5 - + _.£3 — + ..J_ 

3 A 3 

p + q p + pq + q 



ft) • ft 
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Obviously, 




q 5 + p > q 5 + 2 P g 2 + p_ 
p 3 + q p 3 + 2p 2 q + q 

where 



2pq 2 < 2p 2 q . 



Thus for n = 4, the optimal algorithm is f| = < 1,1,3 > 
For the case of n = 5, the possible forms of algorithms 
f = < r(2), r(3) , r(4), r(5) > are as follows: 



fr = < 1,1, 1,1 > 



f| = < 1,1, 1,3 > 



f 5 = < 1,1, 2,1 > 

f 7 = < 1,1, 2, 3 > 

f 9 s = < 1,1, 3,1 > 

f^ 1 = < 1,1, 3, 3 > 

f^ 3 = < 1,2, 1,1 > 

f* 5 = < 1,2, 1,3 > 

f * 7 = < 1 , 2 , 2,1 > 

1 Q 

fg = < 1,2, 2, 3 > 
f 21 = < 1,2, 3,1 > 
f 23 = < 1,2, 3, 3 > 



-5 

-8 

5 

-10 

’5 

-12 

-5 

-14 

-5 

-16 

■5 

-18 



>20 

t 5 

f 22 

5 

r 2 4 



< 1 , 1 , 1,2 > 

< 1 , 1 , 1,4 > 

< 1 , 1 , 2 , 2 > 

< 1 , 1 , 2, 4 > 

< 1 , 1 , 3 , 2 > 

< 1 , 1 , 3, 4 > 

< 1 , 2 , 1 , 2 > 

< 1 , 2 , 1,4 > 

< 1 , 2 , 2 , 2 > 

< 1 , 2 , 2 , 4 > 

< 1 , 2 , 3 , 2 > 

< 1 , 2 , 3 ,4 > . 
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The following algebraical proof reveals that the optimal 

g 

algorithm is f* = f° = < 1,1, 2, 4 > and the maximum ratio 
A^/B^ of this algorithm is (q 3 + 2p 2 q + p 3 ^ 3 + 2 Pq 2 + q 3 ) 
for all value of pe(%,l). 

Proof . If it is simpler to break the possible f's into a 
group of 4 and identify the maximum ratio A^/B^ among the 4 
and the result of these 6 groups will be compared later. 

f^ = < 1,1, 1,1 >; from the case n = 4 , f 4 = < 1,1,1 > we 

have 



A^ 1 , A 2 1 , Aj 1 , A ^ 1 . 

. . A 5 = q 4 + pCA^q 3 + A 2 q 2 + A 3 q + A 4 ) 

= q 4 + pq 3 + pq 2 + pq + p 

= 1 




f 2 = < 1,1, 1,2 > ; 

A o 

A 5 = q + p(A 2 q + A 3 q + A 4 ) 

= q 4 + pq 2 + pq + p 

. . B 5 = p 4 + p 2 q + pq + q 

2 

= g 4 + pq 2 + pq + p 

’ V B r J 4 2 

'5* p + pq+pq + q 
f 3 = < 1,1, 1,3 > ; 
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A 5 = q 4 + p(A 3 q + A 4 ) 
= q 4 + pq + p 

and 



b 5 = p 4 + pq + q 




f 4 = < 1,1, 1,4 > ; 
A 5 = q 4 + pA 4 
= q 4 + p 



B 5 = p 4 + q 




Consider 2pq > 0 ype(%,l) 

1 + 2pq > 1 

1 > (P + q) 2 - 2pq 

1 > p 2 + q 2 = p 2 + pq 2 + q 3 

= pCp + q 2 ) + q 3 
= p(p 2 + q) + q 3 

= p 3 + pq + q 3 
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A 



1 



and 



and 








.B 



(p + q) + pq 

.4 . _■» . 2 




.B 




B 



- j * - P - > Cq _ + -P . ) — ^—^3 — + since pq 2 < 

p + q (p + q) + p q + pq 



2 . 2 

p q 






j is maximum in this group of 4. 



fj? = < 1,1, 2,1 >; from the case n = 4, the algorithm of 
the form f 3 = < 1,1,2 > we have = A 2 = A^ = 1 and A^ = 
q 3 + pq + p. 

A 5 = q 4 + p(A 1 q 3 + A 2 q 2 + A 3 q + A 4 ) 

4 3 2 3 2 2 

=q +pq +pq + pq + pq +pq+p. 

After simplifying we get 

A 5 = (p 2 + q) (pq + 1) 

B 5 = (q 2 + p) (pq + 1) 

/ M 5 = tel * qHpq * 11 . J since p 2 ♦ q = q 2 + p. 

^ s' (q z + p) (pq + i) 



f” = < 1,1, 2, 2 > ; 

2 

l 2 q + <l 3' 



5 

v 5 



Ar = q 4 + P(A 9 q 2 + A,q + A ) 
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B. 




£ 



7 

5 



A 



5 



and 



B. 




f 



8 

5 



A 



5 



B, 



8 




4 2 3 2 2 

q +pq +pq+pq + p q + p 

2 2 

q + p q + p 

p 2 + pq 2 + q 

q 2 t p 2 q * p 

2 2 

p + pq + q 

< 1 , 1 , 2, 3 > ; 

q 4 + P(A 3 q + A 4 ) 

4 3 2 2 

q + pq + pq + pq + p 

3 2 

q + p q + p 

3 2 

p + pq + q 

3 2 

q + p q + p 

3 2 

p + pq + q 

< 1 , 1 , 2, 4 > ; 

q 4 + p(A 4 ) 

A . _ 0 3 , 2„ . 2 

q + pq + pq + p 

3 2 2 

q + p q + p 

3 2 2 

p + pq + q 

3 2 2 

q + P q + P 
3 2 2 

p + pq + q 

3 2 3 

fl.l..+_ 2 P._q._ + . .p. . 

3 A _ 2 3 * 

P + 2pq + q 
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o 

Among 5,6, 7 and 8, the ratio (A^/B^) is the 
Consider 2pq > 0 



maximum , 



. . p(l - p) + q(l - q) > 0 



. . p - p 2 + q - q 2 > 0<=£p + q > p 2 + q 2 
. . p + q + pq > p 2 + q 2 + pq 

(p + q) (p - q) + pq(p - q) > (p - q)(p 2 + q 2 + pq) 

p 2 - q 2 + p 2 q - pq 2 > p 3 - q 3 

c, 3 ♦ p 2 q ♦ p 2 > p 3 ♦ pc, 2 ♦ q 2 =*(^) 8 > 1 -Qgj. 

Consider 




B 



2 2 3 2 2 2 

= 3 + p q + p = q + pq + p + pq + pq 

2 2 3 2 2 2 

p+pq+q p+pq+q+pq+pq 



3 2 2 

< q + p q + p 

3 2 2 

p + pq + q 



since 



pq 3 + 



pq < p q + pq^ 



G9‘ • ft)' 



From 



> 5 / V + pq + q 



rewritten as 
7 



VV = q 3 1 2p 2 g + P 3 + pq 
B 5' p 3 + 2pq 2 + q 3 + pq 
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3 -) 2 . 3 f 

a + 2 p q + p > (a 

3 2 3 

P + 2pq Z + q- 5 



3.-2 
+ 2p q 



p 1 + pq 



(P + 2pq + q ) + pq 




B 




, B 



y 

f^ = < 1,1, 3,1 >; for the case n = 4, the form f^ = 

3 

< 1,1,3 > we have = 1 , = 3 and A^ = q + p. 

. . A 5 = q 4 + p (A 1 q 3 + A 2 q 2 + A 3 q + A 4 ) 

4 . 3 ^ 2 , 3 . 2 

= q + pq + pq + pq + pq + p . 

After simplifying we get 

. 3 2 

A 5 = pq + p + q 



Be = p q 



= p 3 q 



q + p 

2 . _ 



— + P + ^ < 1 since pq 3 < p 3 q. 

p q + p + q 



fg 0 = < 1,1, 3, 2 > ; 

A o 

A 5 = q + p(A 2 q + A 3 q + A 4 ) 

4 2 3 2 

= q + pq + pq + pq + p 

3 2 2 

= q + pq + pq + p 



= q + p 

B 5 - P 2 * q 

= q 2 + p 




10 



= 1 
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f 



11 

5 



< 1,1,3, 3 > ; 



A 



5 



q 4 + p(A 3 q + A 4 ) 

4 3 2 

q + pq + pq + p 

3 2 

q + pq + p 




q 3 + p 
p 3 + q 




= q * P 

p 3 + q 



fj = < 1,1, 3, 4 > ; 

A 5 = q 4 + pA 4 

4 3 2 

- q + pq + p 




This group from 9, 10, 11 and 12 the ratio (A(-/B<.) ^ is 
maximum. Clearly 




Since 

^ 2 
P > P 

* 2 
. . 1 > p + q 
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and 



p + q > p 2 + pq + q 2 

(p + q) (p - q) > Cp - q)(p 2 + pq + q 2 ) 

2 2^3 3 

p - q > p - q 

3 2 3 2 

q + p > p + q 



3 2 

q + P 

3 . 2 

p + q 



1 — » 




12 




10 



( V)“ . ai_i_£. 

W p 3 ♦ q 



3 2 

q + p + pq 

3 2 

p + q + pq 



3 2 

q + p 

3 2 

p + q 



GST - (»" ■ 



13 

= < 1,2, 1,1 >; from the case n = 4, the form of 

? 

f 4 = < 1,2,1 > we have A^ = A 2 = 1 , A^ = q + p and A^ = 

2 2 2 2 

q + pq + p = p + q + pq 

. . A 5 = q 4 + p(A 1 q 3 + A 2 q 2 + A 3 q + A 4 ) 

4 3 2 32 322 

=q + pq + pq +pq +pq+p +pq + pq. 



After simplifying we have 



a 5 = pq 2 + q 2 + P 

• • B 5 = p 2 q + P 2 + q 
2 2 

= p q + q + p 




2 . 2 , o o 

^9 %r P- < l since pq < p q. 

p q + q + p 
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fj 4 = < 1,2, 1,2 > ; 

A 5 = q 4 + p(A 2 q 2 + A 3 q + A 4 ) 

4 2 3 2 3 2 2 

= q + pq + pq + p q + p + p q + 

3 2 2 2 2 

= q + pq + p + pq + pV 

2 2 2 

= q + p + P q 

* 2 2 2 

. . B^ = p + q + pq 



pq 
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2 2 2 
= q + p + p q 



= 1 . 



.15 

'5 



ft"* = < 1,2, 1,3 >; 



A 5 = q 4 + p(A 3 q + A 4 ) 



4 3 2 3 2 2 

= a + pq + pq + P + pq + pq 



= q 3 + p 2 + p 2 q 2 + 

= q 3 + p + p 2 q 2 

b 5 = p 3 + q + p 2 q 2 



pq 



(£) 



f 46 = < 1,2, 1,4 > ; 



15 3 2 2 

= q + p + p q 

3 2 2 

p + q + P q 



= q 



A s = q 4 + p(A 4 ) 



3 2 2 

+ p + p q + pq' 



2 2 



= q 4 + p(p 2 + q) + p 2 q 

4 2 2 2 2 2 
=q + pq + pq +p since p + q 



q 2 + p 
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. . B 5 = p 4 + P 2 q + p 2 q 2 + q 2 



/M . q 4 j pq 2 + P 2 q 2 + p 2 
V B 5 / " p 4 + p 2 q + p 2 q 2 + q 2 * 



This group from 13, 14, 15 and 16, the ratio (Ag/B^)^ 
is the maximum. Clearly (A^/B^)'*' 4 > (A^/B^) 4 ^. 

Consider 

1 > 1 - pq 

i > (p + q) 2 - pq = p 2 + pq + q 2 

p + q > p 2 + pq + q 2 

p 2 - q 2 > (p - q) (p 2 + q 2 ) + pq(p - q) 

p 2 - q 2 > (p - q) (p + q) Cp 2 + q 2 ) + pq(p - q) 

2 2 4 4 2 2 

p - q > p - q + p q - pq 

4 2 2 4 2 2 

q + pq Z + p > p + p q + q Z 

and 

42222 4 2 2 22 

q + pq + p + p q > p + p q + q + p q 




= q 4 .. - 1 : p.q 3 + ..p. 2 . + . .pq. + ,E 2 q 2 . 

4 3 2 2 2 

p + pq + q + pq + pq 



= g 4 + pq 3 + p 2 + pq 2 + p 2 q + p 2 q 2 

p 4 + p^q + q 2 + p 2 q + pq 2 + p 2 q 2 

= g 4 + pg 2 + p 2 + p 2 q 2 i pq(q 2 + p) 

p 4 + p 2 q + q 2 + p 2 q 2 + pq(p 2 + q) 
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4 2 2 2 2 

q +pq + p + pq 
2 2 2 2 
+ p q + q + p^q 

+ q) . Thus 



17 

f 5 = < 1,2, 2,1 >; from the case n = 4 the form f^ 

< 1,2,2 > tells us that = 1 , = q 2 + p and A 4 

q 2 + p. 




A r = 



q 4 + p(A 1 q 3 + A 2 q 2 + A 3 q + A 4 ) 



4 3 2 3 2 ? 2 

~ q + pq + pq + pq + pq + pq + p 

2 3 2 22 

= q + pq + p q + pq + p 

3 2 2 

= pq + p + q + pq 

3 2 

= pq + p + q 



• 3 2 

. . Bj.=pq + q + p 

= p 3 q + p 2 + q 



. * / M = pq 5 + p 2 + q 

[ B s) p 3 q + q 2 + p 



3 3 

< 1 since pq < p q, 



1 8 

fj = < 1,2, 2, 2 > ; 

A 5 = q 4 + p(A 2 q 2 + A 3 q + A 4 ) 

_ .4 2 3 2 2 2 

-q +pq +pq +pq+pq +p 

= q 3 + pq 2 + pq (p + q) + p 2 

= q 2 + pq + p 2 
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B. 





1 . 



£ 



19 

£ 



1 , 2 , 2, 3 >; 



A 



5 




q 4 + P(A 3 q + A 4 ) 

4 3 2 2 

q + pq + p q + pq 

3 2 2 2 

q + pq + pq + p 

2 2 2 
q + p q + p 

q (q + p 2 ) + p 2 

q Cq 2 + p) + p 2 

3 2 

q + pq + p 

q 3 + p 
p 3 + q 

q 5 + p . 

p 3 + q 

1 , 2 , 2, 4 

q 4 + p(a 4 ) 

4 2 2 

q + pq + p 

4 2 2 

p + p q + q 

4 2 2 

3 U33 

4 2 2 

P + pq + q 



P 



2 
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4 2 2 3 

= q + pq + p q + p 

4 2 2 3 

p + pq + pq + q 
= q 4 + pq + p 5 

4 3 * 

p + pq + q 

In this group from 17, 18, 19 and 20, the ratio (A 5 /B 5 ) 2 ® 

1 o i 7 

is the maximum. Clearly (A^/Bg) = 1 > (A 5 /B 5 ) 

Consider 

pq > 0 

2 2 ^ 2 . 2 

p + pq + q >p + q 

(p - q)(p 2 + pq + q 2 ) > (p - q) (p 2 + q 2 ) 

p 3 - q 3 > (p - q) (p + q)(p 2 + q 2 ) 

- (p 2 - q 2 ) (p 2 + q 2 ) 




3 2 

= q - _ LX + pq 

p 3 + q 2 + pq 

4 3 2 3 

= q + pq + P q + P + pq 
4 3 2 3 

p + pq+pq +q + pq 
= q . 4 1 pq * p 5 + pqCg 2 + p ) 

p 4 + pq + q 3 + pq(p 2 + q) 
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q + pq + P 

4 , , 3 

p + pq + q 




20 




19 



-21 



fi- = < 1,2, 3,1 >; the form f^ = < 1,2,3 > having 



A 2 = 1 ; Aj = q 2 + p and A^ = q 2 + p 2 . 



= q 4 + p(A 1 q 3 + A 2 q 2 + + A 4 ) 

= q 4 + pq 3 + pq 2 + pq 3 + p 2 q + pq 2 + p' 



3 3 2 3 

= q + pq + pq + pq + p 

• 3 3 2 3 

. . B r =p + pq + pq + pq + q 



'Mb 



ft) 



5 

21 



q 5 + pq + p 5 + pq 5 + pq 2 < 1 

3 3 3 2 

p +pq+q +pq+pq 

3 2 3 2 

since pq + pq < p q + p q. 

f 22 = < 1,2, 3, 2 > ; 

A 5 = q 4 + p(A 2 q 2 + A 3 q + A 4 ) 

4 2 3 2 2 

= q + pq + pq + p q + pq + p' 

3 2 3 

= q + pq + pq + p 

• • B 5 = p 3 + p 2 q + pq + q 3 




p 3 + pq + q 3 + p 2 q 



A 5 = q 4 + p(A 3 q + A 4 ) 
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4 3 2 2 3 

=q +pq +pq+pq +p 

3 3 

= q + pq + p 

. . B 5 = p 3 + pq + q 3 




:24 



< 1,2, 3,4 



A r = 



4 4 . . 3 

q + pq + p 



q 2 (q 2 + P) + P 3 
q 2 (p 2 + q) + p 3 



* B 5 
24 



3 2 2 3 

q + p q + p 

3 . 2 2 . 3 

p + p q + P 




/ = 1 . 



This group from 21 to 24 are dominated by the maximum 
ratio from the other groups. 

We have left to identify the maximum ratio among (A^/B^)^, 
(A 5 /B 5 ) 8 , (A 5 /B 5 ) 12 , (A 5 /B 5 ) 16 , and (A 5 /B 5 ) 20 . 

First let us prove the algebraical fact that if a > 0, 
b > 0 , c > 0 , and d > 0 then for a > b and c > d, we have 



a + c a + d 

b + c b + d 



( 1 ) 



and 




a + c 
b + d 




< 



c 



d * 



( 2 ) 
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Suppose 



where c > d 



a + c a + d 

b + c b + d 



. * . (a + c) (b + d) > (a + d) (b + c) 

ab + ad + be + cd > ab + ac + bd + cd 
d(a - b) > c(a - b)- 

and 

(a - b) >0 

. . d > c contradiction. 

. . if a > b and c > d then a+c/b+c < a+d/b+d proved (1) . 
From (2) suppose a/b > (a+c)/(|} + d) where a/b < c/d . . ab + ad 
> ab + be. a/b > c/d contradiction. . . if a/b < c/d then 
a/b < (a+c)/(b+d) proved (2). 

Consider the ratio 




4 2 2 2 2 

= q .+ pq + p q + p 

4 2 2 2 2 

p + p q + p q + q 

4 2 2 2 2 3 

q + pq + p q + p q + p 
4 2 2 2 2 3 

p 4 + p Z q + p Z q + pq Z + q 

= q 4 + pq(p + q) + P 5 + p 2 g 2 

p 4 + pq(p + q) + q 3 + p 2 q 2 



4 3 2 2 

_ q +pq+p + P q 

4 3 2 2 

p 4 + pq + q- 5 + p Z q 




which is greater than 1. 
Consider the ratio 
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4 




_s ) = q + p 



p 4 + q 



4 2 

= q + pq + p 

4 2 

p + pq + q 

4 3 

= 3 !_££_! _£ 

4 z 2 

p + pq + q + pq 
> q 4 + pq + p 5 = 

p 4 + pq + q 3 B ' 



Since by the result of (2) and 

nil = e > q 4 + pq + p 5 

pq 2 q p 4 + pq + q 3 

shown as follows: since 

4 3 2 2 4 

p + p q + p q + pq + q 4 > o 

. . (p 4 + p 3 q + p 2 q 2 + pq 3 + q 4 ) + pq > pq 



(p-q) Cp 4 + p 3 q + p 2 q 2 + pq 3 + q 4 ) + pqCp-q) > pqCp + q) Cp - q) 



5 5^2 2 . , 2 2 n 

p - q + p q - pq > pqCp - q ) 

5 2 . 3 3 5 2 

p + p q > p q-pq + q + pq 
p 5 + p 2 q + pq 3 > q 5 + pq 2 + p 3 q 
pCp 4 + pq + q 3 ) > q(q 4 + pq + p 3 ) 

4 3 

E > q + pq + p 
q p 4 + pq + q 3 





20 




16 



Consider the ratio 




3 2 

q + p q + 



3 2 2 

p + pq + q 
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\ 2 2 

= % t p + p q 

3,2, 2 

p + q + pq 



> 





Since by the fact of (2) and 



2 3 2 

2—3. = E. > 3__ E_ shown as follows: we have 

2 a 3.2 

pq 4 p + q 



3 3 

V + q- 5 > 0 

p 2 (l - q) + q 2 (1 - p) > 0 

2 2 7 7 

P - P q + q - pq > 0 



2 2 2 2 
p, + q > p q + pq = pq(p + q) 



(p 2 + q 2 ) (p + q) > pq 
(p 2 + q 2 ) Cp + q) (p - q) > pq(p - q) 

p - q > p q - pq 
p 4 + pq 2 > q 4 + p 2 q 
pCp 3 + q 2 ) > q(q 3 + p 2 ) 






3 2 

q + p 





12 



Rewritten 




= g 4 - 1 - pq(q 2 + p) + p 2 
p 4 + pq(p 2 + q) + q 2 



_ q 4 + p 2 + pq (q 2 + p) 
p 4 + q 2 + pq(q 2 + p) 



= pq 

> q 
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Consider that 



1 > p 

. 2 
P > P 

1 + p > 1 + p 2 

1 > 1 - p + p 2 

l>l-2p+p 2 +p 

1 > q 2 + p 

- . pq > pqCq 2 + p) . 

By using the fact from (1) and the result shown above we have 

q 4 + p 2 + p . q(q . 2 + p i > q 4 + p 2 + pq = q 4 * p = (M 

p 4 + q 2 + pq(q 2 + p) p 4 + q 2 + Pq p 4 + q ' B 5' 




o 

Thus is the maximum ratio of the case n = 5 

g 

and this means f^ = < 1,1, 2, 4 > = f* is the optimal algorithm 
and we have completed the proof. 
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APPENDIX B 



//B0CC2894 JOB ( 1205 , 0530 , R0X2) CHODChCEY SMC 2899' 
// EXEC FORTCLG, REGION. G0=100K 
/ /FORT . SYS I N DD * 



THIS PROGRAM CONSISTS OF TWO PARTS, ONE IS 
THE MAIN PART WHICH DETERMINING THE POSS 
-I BLE ALGORITHM FOR A SPECIFIC VALUE OF N 
FOR EACH OF THIS ALGORITHM, THE VALUE OF 
A ( N) /B ( N )/ IS COMPUTED BY PART TWO OF THE 
PROGRAM WHICH IS THE SUBROUTINE OF THIS 
PROGRAM. FOR THE VALUE OF N=5,6,7 AND 8 
THE PROGRAM WORKS OUT SAT I S F ATORRI L Y - 
WITH TIME. BUT FOR N=9 AND 10 THE PROGRAM 
IS TIME CONSUMING. 

IN ORDER TO SOLVE OUT THIS 
PROBLEM , WE NEED TO ELIMINATE SOME 
ALGORITHMS WHICH SEEMED NOT TO FIT THE 
PATTERNS OF THE OPTIMAL ALGORITHM FOR 
THE CASE OF N SMALLER THAN 10, SINCE ALL 
THE SOLUTIONS SEEM TO HAVE DEFINITE PATT 
-ERN OF OPTIMALITY ON A GIVEN VALUE OF P. 
NOTE THAT THE PROGRAM DOWN BELOW CAN BE 
USED FOR THE CASE OF N=10 ONLY, IF THE 
CASE OF SMALLER N WILL BE RUN THEN SOME 
CHANGES MUST BE MADE AS FOLLOW; 

1. ELIMINATE STATEMENTS DO 10 IM*1,M-1 
AND R ( M ) = I M FROM THE MAIN PROGRAM FOR 
ALL M=N+1 , N+2 , . . . , 10 

2. CHANGE STATEMENT TRIM* A( 10 > /8< 10) 

TO TRIM=A(N)/B(N) 

3. AT SUBROUTINE PART, CHANGE STATEMENT 
DO 10 1=3,10 TO DO 10 1=3, N 



REAL*8 A (12) ,B< 12) , SMAX , TRI M, P , Y ( 12) 
INTEGERS R ( 12 ) , G ( 12 ) 

READ ( 5 , 1000 ) Y 
1000 FORMAT (12F4.3) 

DO 100 K3= 1,12 
P=Y(K3) 

DO 6 M = 1 , 1 2 
R (M ) = 0 
6 G (M) =0 
SMAX=0. ODO 
R(2)=l 

DO 10 13=1,2 
R (3)= 13 
DO 10 14=1,3 
R (4 ) = I 4 
DO 10 15=1,4 
R ( 5 ) = 1 5 
DO 10 16=1,5 
R ( 6 ) = I 6 
DO 10 17=1,6 
R ( 7 )= I 7 
DO 10 18=1,7 
R ( 8 ) = I 8 
DO 10 19=1,8 
R ( 9 ) = I 9 
DC 10 I 10=1,9 
R ( 1 0 ) = I 10 

CALL CALCAN (A,B,R,P) 
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TRIM=A( 10)/B( 10) 

I F(TRIM.LE.SMAX) GO TO 10 
SMAX=TR IM 
DO 3 J = 2, 12 
0 G ( J ) = R ( J ) 

10 CONTINUE 

WRITE(6,1001)P 

WRITE (6,3000) SMAX 

WRITE (6,3001)IG( J),J=2,12) 

1001 FORMAT (• • ,T10, • PROBABILITY P =',F6.3) 

3000 FORMAT (• ',T10,' A ( N ) / B ( N ) = *,F16.12) 

3001 FORMAT (• *,T10,‘ ALGORITHM ='//(' SllloJt'O') 
100 CONTINUE 

STOP 

END 

SUBROUTINE 

SUBROUTINE CALCAN ( A , B , R , P ) 

REALMS A( 12) , B( 12 ) 

INTEGERS R { 1 2 ) 

Q=1.0D0— P 
A ( 1 ) = 1 . 0D0 
B ( 1 ) = 1 . 0D0 
A ( 2 ) = 1 . ODO 
0 ( 2 ) = 1 . 0D0 
DO 10 1=3,10 
X1=0. ODO 
X2=0. ODO 
L 1=R( I ) 

L2=I-1 

DC 20 L=L1,12 
X1=X1+P*A ( L ) * ( Q** ( L2-L ) ) 

20 X2=X2+Q*B (L)*(P*#(L2— L)J 
A(I)»Q**( I-1J+X1 
B( I )=P**( I-D+X2 
10 CONTINUE 
RETURN 
END 

/GO.SYSIN DD * 

INPUT DATA 

51 .55 .60 .65 .70 .75 .80 .85 .90 .95 .99 .999 



FOR CASE OF N=10, THE PROGRAM ABOVE WILL 
GIVE THE OUTPUT FGR EACH P IN THE FORM 
PROBABILITY P = ... 

A(N)/B(N) = ... 

ALGORITHM = ... 



UNFORTUNATELY, THE PROGRAM TAKES 0.5 HRS. 
FOR EACH INPUT P, THAT MEANS WE HAVE TO 
USE 7.5 HRS ALL TOGETHER. THE PROGRAM 
BELOW ILLUSTRATED THE WAY TO DECREASE THE 
RUN TIME BY ELIMINATING SOME ALGORITHMS 
WHICH SHOULD NOT BE EVALUATED BECAUSE OF 
THE UNCORRELATED PATTERN TO THE OPTIMAL 
ALGORITHM OBTAINED IN THE CASE OF N - 
SMALLER THAN 10. THE RESULT WAS OBTAINED 
IN ABOUT 7 SECONDS OF CPU. TIME ON ONE 
VALUE OF P AND WAS CHECKED OUT CORRECTLY 
WITH THE CASE OF FULL COMBINATIONS WAS 
USED FOR THE SAME P. 



REAL*8 A( 12) , B ( 12 ) , SMAX, TRIM, P 
INTEGERS R( 1 2 ) , G ( 12) 

READ ( 5 , 1000 ) Y 
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1000 FCRMAT (12F4.3) 

DC 6 M=l,12 

R (M ) = 0 
6 G ( M ) = 0 
P=0 . 5 1 DO 
SM AX= 0 . 0D0 
R ( 2 ) = 1 
R ( 3 ) = 1 
R (4)=1 

DO 10 15=1,4 
R ( 5 ) = I 5 
DO 10 16=1,5 
R ( 6 ) = I 6 
00 10 17=3,6 
R ( 7 ) = I 7 
DO 10 18=4,7 
R ( 8 ) = 1 8 
DO 10 19=6,3 
R ( 9 J = I 9 
R ( 10 J =9 

CALL CALCAN (A,B,R,P) 

TRI M=A ( 10) /B( 10) 

IF(TRIM.LE.SMAX) GO TO 10 
SMAX=TRI M 
DO 8 J=2, 12 
8 G ( J ) = R ( J ) 

10 CONTINUE 

WRITE (6, 1001JP 

WRITE (6,3000) SMAX 

WRITE (6,3001) (G(J) ,J=2, 12) 

1001 FORMAT (• ' ,T10, ‘ PROBABILITY P =*,F6.3) 

3000 FORMAT (• ',T10,' A(N)/B(N) = *,F16.12) 

3001 FORMAT (• ',T10,' ALGORITHM =•//(' SllIOJ^O') 

100 CONTINUE 

STOP 
END 

SUBROUTINE 

SUBROUTINE C ALCAN ( A , B , R , P ) 

REAL*8 A( 12) ,B(12) 

INTEGER*4 R ( 12 ) 

Q=1 .ODO-P 
A ( 1 ) = 1 . ODO 
B(1)=1.0D0 
A ( 2 ) = 1 . ODO 
B(2)=l. 000 
A ( 3 )= 1 . ODO 
B(3)=1.0D0 
A ( 4) = 1 . ODO 
B ( 4 )= 1 .ODO 
DO 10 1=5,10 
X 1=0. ODO 
X2 = 0 . 0 DO 
L 1 = R( I ) 

L2= I- 1 

DO 20 L =L 1 , L2 
X1=X1+P*A(L)*(Q**(L2-L) ) 

20 X2=X2+Q*B(L)*(P**(L2-L) ) 

A ( I ) = Q**( I-D+Xl 
B(I)=P**(I-1)+X2 
10 CONTINUE 
RETURN 
END 



RESULT OF THIS RUN IS ... 

PROBABILITY P = 0.51 
A ( N) / B ( N ) = 1.1296 

ALGORITHM =111345789 
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APPENDIX C 



//BCCC2894 JOB ( 120 5 , 0 530 , R0X2 ) 



CHODCHOEY SMC 2899* 



THIS PROGRAM IS USED IN SEARCHING FOR 
THE OPTIMAL ALGORITHM AT THE VALUE OF P 
EQUALS .50+8 FOR N=6,7,8,9 AND 10. 

THE PROGRAM WAS PRESENTED IN THE 
FORM WHICH CAN BE USED ONLY FOR THE CASE 
OF N=10, FOR THE CASE OF SMALLER N WE 
CAN PREPARE THE PROGRAM AS STATED IN - 
APPENDIX £ 



REAL*8 A( 10) ,B< 10) ,SMAX,TRIM,P 
INTEGERS R ( 10 ) ,G(10) 

P=0.50D0 
DO 6 M=l, 10 
R(M)=0 
6 G ( M ) = 0 
SMAX= 0 . ODO 
R ( 2 ) = 1 

DO 10 13=1,2 
R ( 3 ) = I 3 
DO 10 14=1,3 
R(4)= 14 
DO 10 15=1,4 
R ( 5 )= I 5 
DO 10 16=1,5 
R ( 6 ) = I 6 
DO 10 17=1,6 
R ( 7 ) = 1 7 
DO 10 18=1,7 
R ( 8 ) = I 8 
DO 10 19=1,8 
R (9 )= 1 9 
DO 10 110=1,9 
R ( 10) =1 10 

CALL CALCAN (A,B,R,P) 

T R I M= B ( 10) /A ( 10) 

IF(TRIM.GE.SMAX) GO TO 10 
SMAX=TR IM 
DO 8 J=2, 12 
8 G ( J ) = R ( J ) 

10 CONTINUE 

WRITE ( 6 , 1 001 ) P 
WRITE (6,3000) SMAX 
WRITE (6,3001)(G(J),J=2.10) 

1001 FORMAT (• • iTIO, • PROBABILITY P =',F6.3) 

3000 FORMAT ( ' 

3001 FORMAT (• 

STOP 
END 



, T 10 , ' B ( N ) / A ( N ) = • , F 16. 12 ) 



, T 10 , 



ALGORITHM =•//(' *,1116) , *0* ) 



SUBROUTINE 



SUBROUTINE CALCAN ( A , B , R , P ) 
REALMS A ( 1 0 ) , B ( 1 0 ) 
INTEGERS R ( 10) 

Q= 1 . 0 DO— P 
A ( 1 ) = 1 . ODO 
B ( 1 ) = 0 . ODO 
A ( 2 ) = 1 . ODO 
B(2)=0. ODO 
A ( 3 ) = 1 . ODO 
B ( 3 ) = 0. ODO 
7 DC 10 1=3,10 
X1=0.000 
X2=0. ODO 
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X ( 3 } = 0. 0D0 
L 1=R ( I ) 

L2=I— 1 

00 20 L =L 1 » L2 
X1=X1+P*A(L)*(Q**(L2-L) } 

X2=X2+ ( (L2-U-1)*A(L)*(P**(L2-L) ) 
20 X3=X3 + B(L)*(P**( (L2-U + 1) ) 

A ( I } = ( I-1J+X1 

B(I )=( I-1)*P**( I — 2 ) +X2+X3 
10 CONTINUE 
RETURN 
ENO 
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